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The KducatioiKil Resources Int'ormation Center (KRIC) is a national 
information .system operated by the National Institute of Education. 
KKIC serves the educational community by disseminating educational 
research results and other resource mformation that can be used iu devel- 
oping more effective educational programs. 

The ERIC Clearinghouse on K<lLicational Management, one of several 
clearinghouses in the system, wasVstablished at the University. of Oregon 
in 1966. The Clearinghouse and its companion units process research 
reports and journal articles for announcement in ERIC's index and 
abstract bulletins. 

Research reports are announced \i. Resources in Eclucatioti (R/E), 
available in many libraries and by subscription for $38 a year horn (he 
United Stales Govermncnl Printing Office, ^Vashington, U.C. 20402. 
Slost of llie docimicnls listed in RIE can be purchased through the 
I^RIC Document Reproduction Ser\'ice, operated by Computer Micro- 
fihn Jnternationn! Uorporation. 

Journal :irticles arc announced in Current ftidcx to Journals in Edii- 
cation, ClJE is also availat>lc in many libraries and can be ordered for 
S-t4 a \ ear froni Macmillan Information, 866 Third Avenue, New 
York, New Vork 10022. ;\nnual and semiannual cunulations can be 
ordered separately. 

Resides processing documents and journal articles, the Clearinghouse 
has another major function -information analysis and synthesis. The 
Clearinghouse prepares bibliographies, literature reviews, slalc-of-ihe- 
knowledge papers, and other interpretive resenrch studies on topics in 
its ediicat io.^.al area. 
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With ihc School Leadership Digest scries, the National 
Association of Elementary Scliool Principals adds another 
project to its continuing program of publications designed to 
offer school leaders essential information on a wicle range of 
critical concerns in education. 

The School Leadership Digest is a series of monthly reports 
on top priority issues in educatiom At a time when decisions 
in education must be ni^ide on the\)asis of increasingly com- 
plex information, the Digest provides school administrators 
with concise, readable analyses of the most important trends 
in schools today, as well as points up the pr^K'Mcal implica- 
tions of major research findings. 

By special cooperative arrangement, the series draws on 
the extensive research facilities and expertise of the ERIC 
Clearinghouse on Educational .Vlanagement. The titles in the 
-series were planned and developed cooperatively by both 
organizations. Utilizing the resources of the ERIC network, 
the ClearinghcHL^e is responsible for researching the topics 
and preparing the copy for publication by NAESP. 

The aiuhor of this report, I'erry Barrac lough, is employed 
by the Clearinghouse as a research analyst and writer. 

Paul L. Houts Stuart C. Smith 

Dire ctor of Publications • A ss is taut Dire c tor and Ed it o r 

NAKSP ERIC/CEM 



INTRODUCTION 



It is interesting to note that many administrators and teach- 
ers have taken tlie position that teacher and administrator per- 
formance is too involved and complicated to measure and rank; 
wliile teachers have ranked students by specific grades through 
the years with equally complicated and unrcliabl-: evidence. 

DcVaughn 

Adiiiiiiistralors have always l)ccn evaluated in one way. or 
another. Decisions on hiring, training, promoti(jn, and firing 
of administrators have always been necessary, and such deci- 
sions ai e based on some sort oP evaluation, whether fornial or 
informal, of administrative performance. 

Formal evalu.ation of administrators is a dii'ect result of the 
increasing si/e and complexity of the educational enterprise. 
•The Baitellc Memorial Institute points oiit that, unlike busi- 
ness and i^ndustry, school systems have not traditionally had 
formal procediu'cs for evaluating administrators. When schools 
were small and simply structured, top administrators did 
not need a formal procedure because they could assess the 
strengths and weaknesses of theii- subordinates from fii'sthand 
knowledge. ''The accelerated growth of most school systems 
within the past three decades, however, has produced organi- 
zatiotis of greater size and complexity, and formal procedures 
for evaluating administrators have become a necessity."" 

'l"he C(jneept of accoun tal^lity also has affected admimstra- 
toi' evaluati(,in. .As the pLd:)lic, and in many cases theTegisla- 
ture, pressed scljools to become accountable for their product, 
a formal administrator evaluation process became an indispen- 
sable j^art ol" school operations. 

Administrator e\'aluation ser\'es two major purposes. First, 
an evaluation tells the administrator iiow well he is doing his 
)\)b. Second, it lets others know how well the administrator is 
doing his job. The Bat telle Memorial institute explains u hy 
both |)articipants in the evaluation procedure benefit: ''It not 
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(u\ly enables (he top adiniiiisc rutor to gci a bettrr undnstaiui- 
uvj^ (){' how cttcctivcly an adiiiinislrativc subordinalr is pc-r- 
loiniiiii; but ii also lacilitaics the subordinate's work by 
providing; him with information t'oiucrnino bis supcivisor's 
cxpcrtations, the important rcsponsibibt ics oi his job, and tbr 
alternatives open to bim in perloi-mina bis job." 

In addition, evabiation provides inlormation iisebil in the 
promotion, trLmsTer, trainin^^, and eoirnsebng oC a(hiiinistra- 
tors. Accord ini^ to the institute, e\abiation 'MncUcales bow 
elleeiively an a(bninistiatoi- is functioning in his job and 
whether or not he should continue in that job/' Mvaluation 
results also affect co/uract fenewab 

Tbe need, for formal e\^aluation procedures is being met in 
a variety (d' ways, not all of which are reliable or fair to tbe 
athiiinis rator. One school system may use chec khst foim to 
rate a(hiiinisirators against predetermined standards. Another 
district may use tbe information in an a(buinistvalor\s person- 
nel files to detei-mine bis competence. Still another may use 
the job targets approach, \\orkiiii( with (be administrator to 
set objectives and deternune the administrator's success at 
meetini^ those objeciives. 

Kach approach has advantages and chsadvantages, and each 
has its adherents. Tbe school chstrict must decide which ap- 
proach and then which instrument or procediire best meet 
district needs. This paper ie\ ie\vs literature on e\'aluation plii- 
loso[)hies, pr^>blems, procedures, and instruments, in theoiy 
and in i)ractice, to help the district make those decisions. 



EVALUATION PHILOSOPHY: 

QUESTIONS A DISTRICT SHOULD ASK 



Inilialiiv^ an adniinistraloi- cvaliKiiioii sysloiii clcinaiuls a 
^rcat (leal ot" planning lo cnsuiL- lhat. a iuliai)lc and fair system 
will result. The system must, first of all, eonlorin to distriet 
i^oals and policies. IT a school distiic t is eomniitted to hunian- 
.islie t^oals. lor e\am[)le, the e\ahia(ion system will ha\'e to l)e 
desii^ned to encourage pursuit oi those o^als. 

In order to tiiilov the ev'aluation s\steni to, distriet needs, 
the planners should ask themselves lour key ([uestit)ns: What 
inlormation should the system i)rovitle? Mow will that inlor- 
nuilio.n he used? Whii h i)ersonnL'l will he e\ aluate(l? and. Who 
will evaluate them? The answers to these (ju est ions will dit'ier 
io:iTi distriet to distriet hut will piovide eaeh distriet with its 
own i)hiloS()j)hy of e\alu; tion. l'AalUiiti(Mi philosophy is, after 
all. nothing niore thiin the answers to these four (juestions. 

What Information Should an Evaluation System Provide? 

. The district should deL irie why the\- lieed an e\'aluatit)n 
system. What tlo they nee l to' ki unv ahoui the administrator? 
A(-et)rtlini; to, Camj^hell, "the first stej) is one of ehu ilying the 
purj)oses or lunetions oi administration."" 

After deeidini; on the i)urj)oses of administration, tlie dis- 
trict can decide the Cjiiaiitics net:essary in an adm inlstiator 
anci can set up the evaluation system accordingly. 'l"he system 
should he designed, alter all, to let the distriet knf)W if an ad- 
!i)inistrator is t^ood at administration. 

C.*ami)l)ell sut^^ests tliat the major functions ol" an adminis- 
trator are 

I. Vi) iiiniiciicc the goals and pnqjoscs of the organization aiul to 
help clarify those purposes in and out of the organization 

'2. To encourage and support the developmeiu of programs de- 
signed to implement the puq)()ses 

.S. '!"() recruit and" organize persons into productive teams to 
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implcm'-tu the ;ipj)rt)priaie programs 
. 4. To procure and alldcatt.' the ricccssarv' resources to snpf)ort the 
"X programs in the orcicr of priority established 

5. 'l o cvLihiale I he effectiveness iind efficiency by which all of 
tliesc functions are being achieved 

'rhcrcforc, iIk niaj<)r eniphasis oi" an evaluation system should 
he to ascertain whether the achninistratcjr is [)cri()rni ing his 
five. fiinctions in a manner satisfaetory ((» the cUslricl. 

McCleary believes that ''the purpo^*' of evaluation is (o 
monitor the system and insure quahty eonirol/' achieve 
this end, he reeommeiuls that information on the administra- 
tor's decree oi skill,- his ability to perform certain fimctions, 
his probleni-solvintj ability, and his degree of '^apprc^priate 
{.•oiicertr' for edticalional values he eolleetecl to measine his 
perfonnatue, Mven criteria this vagcie can help the district 
pick a fittiiij; evaluation system. 

Pilaris ar^ties that '*evaltuition should he a matching of'in- 
letit to rustdls, a ri>m|)arison of what was expected to happen 
with what did happen." 'I'his orientation demands that the 
district he sjiecific in setting t^irgets for administrati\e per- 
forniancc. Any evaltiation system designed according to this 
ideal must provide informatioii, on the aclministrator's suc- 
cess at reaching each target, 1 

riu* Battelle Mcnu)rial- Institute adv(>cates d similar ap^ 
p roach: ■ 

"J'lie key lo an objective performance-evaluation pro«j"edure is 
the specification of job responsibilities. . . . 'I'he subordinate, 
L'n^lerslanding these, is ;nvare of wliat is expected ofiiim. The 
• super\'isor, in turn, can point his evaluation toward perform- 
ance in relation to the eslalilished job responsibilities,; In this 
way, the evaluation can be both fair and objective. 

The evaltuition system anust, therelniL*, discover evidence of 
the adminislralcjr's })eri()rmance ol spccrtic j(ih res})onsil)ili- 
ties. 

What the district wants to Imd otit al)()tit administrative 
.performance will determine ihc information necessary for 
evaltiaii(jn. The next c[uestion to l)e answered concerns the 
ultimate tise of that information. 
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How Will the Information Be Used? 



M'Ik- iiironiKition t»:iiluM'ccl IVom an rvalruiiioii ran, ol' coarse, 
be iisccl in many \v;iys. li ran aid ihc (list l irt m niakini> deci- 
sions al)t)iii the administiator. li can also hcij) the adniinisira- 
lor know where he stands. 

The school district often ttses ewiliiation ivsuhs to reward, 
[)iini.sh, or tnoti\ate a(hiiinistraJors. Atnonu Ihe warious pur- 
poses of evaliuitini; achniiristrators. Red! em cites lour that 
predoni in., .e: 

!. lo idc Ml ilV areas ncL'tlint^ improve men I 

'2. t(". measure- c urrent perlormanee against prescribed sianclarcls 

to establish eviclenee to dismiss personnel 
-1. lo eiuihk" the individual to forniulatt' a|)pro})ria(e ])errornianee 

()t)jeeiives 

Ciastctler and lieisler enumcaate sexeral uses ol cxaluation. 
result s: 

• Plac e the individual in ihe system where be ran realize his own 
()hjee(ives and eontribiMe eiTecti^ely to those of {he ori^aniza- 
lion 

• Mi)livaie personnel toward aebievint; personal! and system jt^oals 

• Improve |)errormaiHe 

• I'neover abilities 

• Ascertain liie pr>{en{ia) of th** individual lo perlorm \ariou.s 
types of tasks 

• laieouriige sel ^development 

• Point up eonlimiint^ echiiation needs 

• Provide a ^uide for salary deterniii\iii(ui 

• I'acilitaie mutual understaiulin.i^ between superior arid subordi- 
nate . ' 

» Transfer, demote, ])roinote, or dismiss personnel 

• i>et ermine vvliejiier ihe ori^anizafion should retain liie indi- 
vif.lual as a permanent member 

• Test the validity of rceruitment and selection procedurc-s 

Roscnbcai;'' rcaninds the district iliai e\ali\ation alsoi^i\c-s 
the' adndnistrator iiisi^^ht into aieas of strength and -A-cakness 
and ( lues to ^rcMtca" el 1 ec ti\ enc-ss. 1*'a aUia t i( )n claril ie>. the role 
e\pec;( at ions held Foi- the adniiiu^tr.itor- "by hiniscll, siu- 
denis, staff, coininunity aiul central adininist i at ion," And 



evaluation can he iiistrunuMital in a **c:arccr development pro- 
gram" by • identifying those administrators who possess the 
potential to Till speeiali/ed roles in the school system. 

The major point of any evaluation is and should he, again 
according to Rosenberg,* ''t(j guide and counsel the princi- 
pal—not to check up .on him.'' Used in the traditional manner, 
to reward or punish the administrator, evaluation loses its 
value as a counseling tool. Used constructively to let the ad- 
ministrator know where he is expected to go, how he can get 
there, and where he can look for help, evaluaticjii becomes a 
positive force in the school. 

Lamb agrees with Rosenberg when he notes that adminis- 
trators iiuisi l)e reassured that evaluation can be helpful to 
thein. The administrator under evaluation must feel that the 
process is meaiu to assist him in the performance oi' hi.s duties 
and is not meant to be a ''weapon" against him. 

In order for evaluajlion to be helpful to the administrator, it 
nnist emphasize future instead of past performance, according 
to Pharis. Only by stressing the future can the evaluation proc- 
ess motivate the ■ admjnistvalor to improve his performance. 

Whether evaluation results are used by the district or by the 
administrator for reward, for punishmenx, or for counseling 
will furtlier- liniii the/choices iii sefting up an evaluation sys- 
tem. The next step is deciding which personnel to evaluate. 

Which Personnel Will Be Evaluated? 

All [he writers agree that principals, at least, should be 
evaluated. Rosenberg, in his 1971 article, states that ''a good 
administrator e\aluat ional progiam will residt in a compre- 
hensive, valid and reiial)ie appraisal of the effectiveness of 
each, and every school principal in a school district.'' 

Pharis notes that ''principals tend to view evaluation like a 
mother-in-law- necessary but someiinies difficult to live with.'' 
But even the principals themselves agree about the necessity 
of evaluation. 

.As DeX'au^hn writes, ''advocates of accountability and 



courfs of law arc (Icinandii^j^ an evaluation system for all per- 
sonnel." Many slate and local legislative bodies are requiring 
evaluation of both teaehing aiul administrative personnel, 
'This demand for evaluation of all personnel is being met by 
most sehoo! districts v/ith any sort of evaluation systcsn. Red- 
fern .con firms that, accor^Jing to an Educational Research 
Scivice suivey, ''evaluation [programs a[)ply to all administra- 
tive personnel in inosi instances/' 

I Who Are the Evaluators? 

Most writers refer to persons responsible for evaluation as 
supervisors. It would appear from the research that these per- 
sonnel are in general responsible for supervision of the admin- 
istrator, are in fact administrators themselves, and are in no 
way limited to evaluation in theirduties. 

Although the litcraturcHs vague on this subject, it seems 
reasonable to expect the personnel responsible for evaluation 
to be -experts in evaluation technique. Thus, the assessment 
task should be handled by persons who have been trained in 
the techniques used by the district and whose other duties 
would not interfere, with the job of evaluation. 

There are other questions a district co; ask, and one of 
the more common is: Should adminis ; ator self-evaluation be 
a part of the cvaliuition process? R..' believes that self- 
evaluation '*is the starting point of a comprehensive assess- 
ment of performance effectiveness.'' DeVaughn c(jntends that 
self-evaluation can add a dimension to the cvaliuition process, 
as "the evaluatec perhaps best knows his strengths and weak- 
nesses." 

Howsam ancl Franco advise the school district tc) play down 
formal evaluation. Their apj)r()ach, while contrary .to most of 
the. research, is at least food for thought. They suggest devel- 
oping an organix.ati(.mal climate conducive to performance, 
rather than relying on evaluation to motivate administrators. 
Most pubhcs and legislatures, however, require more objective 
evidence of administrative success than the job satisfaction of 
the administrator. 
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PROBLEMS IN EVALUATION: 

CAN THE RESULTS BE-XRUSTED? 



Rosenberg'*" passes a severe juclgiiiciu on eiirreiu aclminisira- 
live appraisal systems, ealling ihem "woelully iiniclequate aiui 
uiirair/" and based on "imaeeeptable evidence coUeeied with 
undesirable methods Ironi undesiral)le sources/' Ol)viously, 
noevahiation system is free of [)vol)lems, nor is there hkely to- 
be one. Culbertson points out that, because of the incomplete 
development of the sciences of education and nianagcnicni, 
an infallil:>le evahiation system cannot l)e guaranteed. 

..,>s*cver-theless, an understancUng of some of the more com- 
mon prol)lenis should iiei[) a sciiooi ciistrict plan its e\'aiuation 
process more reahstii'aiiy ^so that those proi)lems can at least 
be minim i/ed. 

Campbell identifies three very general evaltiation problems. 
First, forces from inside and (.)titside the sclu)ol limit what an 
administrator can do. For instance, Cam[)bell states, j 

I do not recall a single major proposal sponsored by the Hoard 
of Education or the General Superintendent of the Chicago 
Schools over a recent four- year period that did not meet with 
the immediate opposition of 40 to 60 per cent of the titi/.ens. 
Administrators often work within very narrow tolerances. 

These limitations can keep an administrator from living up to 
an evaluaior's expectations. 

Secoiul, no commoidy ac:cei:)ted definition of the adminis- 
trator's rt)le exists. Cami:)bell indiicatc's the wide variety c)f ad- 
ministrator role e\j)ectations lield l)y tlie public, as well as i)y 
.those in (he strhools. Some expect tiie administrator to i)e 
l)rimarily an educator, whereas others see him as **an adroit 
managei' of the organization/' or as a [)ul)lic relations manager 
wh^'se ciiief duty is to gain pul)lic sup[)ort ("bollv psyclio- 
logical and financiaP') for the schools. This disagreenieiil 
makes evaluation difficult. 
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Third, confliris in values coinpliciitc ihc task of cvaluatioiK 
For example, aclnuiiistrators arc cauglu in the middle of the 
debate between humanists, who advocate student IVeedcm, 
and disciplinarians, who favor strict enforcement of rules. 

Castetlc?* and Ileisler cite in( »rc specific i)r(»hlcuis. Evalua- 
tions often focus on the i)ersonaliiy of liie administrator, 
rather than on results, and iTjost evaluators are not qualified 
to appraise personality. Also, evaluation results are not used 
to encourage individual development, so evaluation loses its 
value as a counseling tool. 

In addition, evaluations and evaluators are influenced by 
the district and arc often l)iased. What is expected of an 
administrator is seldom made clear before evaluation, and 
administrators frequently do not understand the criteria 
against which their licrformaiice will be measured. 

Process of Evaluation , 

Once the i)rocess of evaluation has begun,* cUher problems 
surface. Pharis rejxnts two flaws in all evaluation procedures. 
Th e f i rs t , t h c // alo cjjccL is t h e t c n d e n cy to i\i t e a pc rs o (i h igh 1 y 
for various subjective reasons. The second, horn effect^ is 
the tendency to rate a person poorly for subjective reaso:is. 

LA'aluatt)rs tend to turn in favorable evaluations because of 
an administrator's past record. Good work in the past can 
carry oyer into the present, and a good job yesterday is more 
impressive than a good job last week or last month . An evalua- 
t(>r also tends to have blind sjDOts. Me fails to see defects 
similar to his own. He may also rate administrators he likes 
higher than he rates those he dislikes. 

The horn effect works in the opposite direction. An evalua- 
tor*s expectations may be too high. Fie may also rate jjoorly 
thei)erson who disagrees too frequently, or the maverick who 
simply does not conform. Guilt by association can cause a 
rating to fall, since a man is often judged by the company he 
keep,s. In addition, a dramatic incident, a recent mistake of 
large proportions, can soil an otherwise unspotted record. 

Several other procedure problems arc apparent to Castctter 
and Heisler. Traditional evaluation procedures keep the 
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cvaluulor and adiiiinisiralor i'roi i coiniimnicaliiig cticctivcly 
with each other. The evahiator's heavy rehaiice on feelings 
instead of i'aets causes the aciniinistratoi to reaet defensively. 

Evaluation Instruments 

Evaluation instrunients are often faulty. 3ernstein and 
Sawyer argue that suhjeetive evaluation instrunients— graphs, 
checklists, and similar devices- arc seldom adequate lo meas- 
ure an administrator's performance. Such instriunents usually 
use general and impersonal criteria and sometimes confuse 
means and ends. 

Caste tter and lie isle/' also feel thai mc.fst insti'uments tend 
to fragment the administrator, into personality parts. Even 
when added logether, those parts do not give a complete pic- 
ture of the administrator, let alone of his perfoi*manee. 

Pilaris distrusts most evaluation instrLuiienis. He complains 
that ''typical rating iiistrLUiients devote considerable space to 
manner of dress, oral expression, and other factors that are 
more indicative of personality than administrutive ability/' 
He believes, in addition, that checklist evaluations are one- 
sided and subjective. Such evakiations do not encourage the 
administrator to participate in the process of evaluation, and 
they do not help him improve his performance. 

Checklists measine. the person rather than the job. They 
do not docanient administrator performance. I'he iiudtiple 
evafuator checklists used by many districts merely compoinid 
the snbjeetivity. 

.Another type of evaluati(jn, usually called sec(jndary results 
evaluation, uses the achievements (jf those imder superx'ision 
to evaluate administrator j)erf(ji'niance. For example, princi- 
pals are often evaluated according to student scores on stand- 
ardized "tests. Such evaluations often credit the administrator 
with too much conti'ol o\'ei' his envii'onnient. 

l'*ilcs or personnel records are also used occasionally to 
evaluate the administrator. Pharis contends, however, that 
files include too much irrelevant matter to be useful in docu- 
menting administ rative performance. 
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EVALUATION PROCEDURES: 
TAKING THE NECESSARY STEPS 



While tlicic is considerable (lisa.^rcciiicn t concci'ii iii^ iiicth- 
ocls aiul insii'iimcnts oi" .evaluation, most /writers aeree that 
the distriet should establish a set of procedures in advance. 
I'hese pvoeedures then provide a framework for the evaluation 
process. 

Specific prt>ce(lures .nuiy differ i'vom one disu icl to the 
next, dcpendini^ on the pariicuhir evaluation niethods and 
instruments used. There is .genera! ai^reenient, however, on at 
least four steps in the task of evaluation : the pi*eevaluat ioii 
conference, evaluatit^n, the postevaluation conl'erenc:e, and 
followu|) ac tion. .Many of the researcheis would add adminis- 
trator sell-evalualion to the list of essential procedures. 

The Preevaluation Conference 

DeVauj^hn considers the preevaluation conference essential 
and says that e\'aluation ''should begin with orientation of 
evalualees and evaluators, as well as re\'iewing officials'' to 
the policy, pn>cedures, and instruments of evaluation. In this 
way, each person eoiu'erned with the evaliuition process will 
know what is expected of him. 

Bric"k and Sanchis cite four pinposes of ihe preevaluation 
ct)nferenc-e in the job targets appi'oach: 

1. Idcntificiition of the current school needs 

2. Mutual development of goals by the principal and his cvaluator 
.S. 'IVanshition of goals in measurable ol)jectives 

Selection of activities through which each objective will be 
achieved 

Poliakoff agrees that the administrator and his evaluator 
should tneet to set goals and time limits and to de\"elop a 
program of acti(jn to meet those goals. 

The preevaluation conference, is admittedly more impcjrtant 
to the job targets approach than to the performance star. .*ards 
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approach. A lair evaluation, however, will always Ici the ad- 
ministrator ill on the district's expectations of him, the instru- 
ments used to evaluate him, and the criteria he will be expected 
to meet. He should know (he rides of the game before he is 
asked to phiy. These piuposes are best served by a conlcreiu e 
of (he administrator and his evalualors prior to evaluation. 

Evaluation 

The actual evaluation must assess the overall job done by 
the achiiinlstrator, accordin^^ to Brick and Sanchis. This part 
is by far the most difficult and uncertain aspect of the evalua- 
tion process. 

Peebles maintains that evaluation shoidd include ''.sufficient 
contact with the individual in his usual working area so that 
the evaluator feels competent to discuss the evaluatee's per- 
^forniance." OeVaughn calls for ongoing appraisal of adminis- 
trative perfohiiance after the * job tasks" have been agreed 
upon, lie emphasi/es that this continuous evaluation should 
be constructively communicated to the evaluatee, wh(^ should 
be oflered assistance in his efforts to. improve his perform- 
ance. His faii\nes, as well as his accomplishments, should be 
given "forthright recognition.'' 

The partieida^^ evaluation method depends on the instru- 
ment or approach used. The process of gathering information 
for a job targets evaluation differs sharply from that of filling 
out objective forms, for example. Whatever the instrument or 
a|)proaeh, the evaluation itself is a crucial stage in any admin- 
istrat(3r evaluation system. 

The Postevaluation Conference 

The postevaluaiion conference is recommended as an ap- 
propriate feedback mechanism for the administrator. Such 
a conference should include the same personnel as the 
preevaluati(jn conference and should be, to all intents and 
purposes, an extension of the earlier conference. 

It is in the postevaluation conference that the administra- 
tor is informed of evaluation results and given the opportunity 




to discuss liis j( )1) ijcrloiiiiaiu'c witli ilic cvalualor. Peebles 
cites three areas of diseiission: (he ^t'oals or oljjeetives agreed 
oil in the preevaluaiion con Terence, the administrator's, c)\'erall 
j)errorniance accordin,^ to district standards, ancl theadminis- 
traKM^'s pert'orniance ol"s))eciric rcsponsil)illiies. 

Tlie ))ostevaluation Conference is the recycling stage oi' 
evahiation. At this point, the results are in and it is up to :he 
administrator and the evaluator! to use the achiiinistrator's 
])as( ])err()rmaiue to predict his future success aiid, more spe- 
cifically, to sei.new goals lor him. I'ollowup action must also 
he determined. 

Foiiowup Action : 

Red fern describes followu)) Miction as '^certain kinds of suh- 
se(jneiil activ ities to reinforce iictiojis taken during the year/' 
'I'hcse activities might include, h)r example, further work on 
a i)articolar i)rojeet, addili(Jnal training, or renewed attention 
to a pressing problem. 

The administrat(M- and evaluator should, (luring the post- 
evi'.huition cr)nfcrence, "))in)3oint those activities,'' and ''con- 
sider next steps." Redfern warns, hcnvever, that *'if it appears 
that followu]) assistance should he given, the evaluator shoulcl 
make comnVumenls reaiistieaiiy. Promises that ean'l be kept 
shouldn't he made." 

Kollowu]) action is not mandatory in the majority of eases. 
When the need for such action is indicated, however, the ad- 
ministrator and evaluator should consider it with the same 
care and attention to detail that characterized the preevalua- 
Lion conference. Carefully planned folio wiij). action can be a 
means ol im])rov'ing administrative performance. 

What hai)i)cns if the evaliuuion is unfavorable, ()r if there is 
contention over the results? The administrator should be 
given, and is often legally guaranteed, the right to a hearing 
on the results of an evaluation. This is especially true if his 
jol) hangs in the balance. 

Poliiikoff cites three solutions to the [)r()blem of disagree- 
,meiU over evaluation results: both the evaluator's findings 
and the administrat(jr's self-evaluation can go nn file, the 



administrator can appeal to a higher authority or to a griev- 
ance board, or the adininistrator can be counseled. 

The latter solution is perhaps the most novel. Under the 
Worcester, Massachusetts, evaluation system, ihc '^administra- 
tor can be counseled by three supervisors other than his origi- 
nal evaluator. The administrator chooses one consultant, the 
original evaluator chooses one, and the two consultants al- 
ready chosen choose the third. 

For a peri(ul of six weeks, the three consultants monitor 
the administrator and suggest sources of assistance. If, after 
the consultation, the evaluation is still negative, the adminis- 
trator is subject to recvaluation the following year. This pro- 
cedure gives the administrator ample opportunity tv) learn 
what is expected of him and to improve his performance 
accordingly. 

Self-Evaluation 

Although not all writers agi"ee on the necessity of self- 
evaluation, there is considerable agreement on its value in a 
well-designed evaluation system. Ideally, it would occur at the 
same time as evaluation by a trained evaluator. 

Notuig that '\seir-assessment is a subtle process," Red fern 
outlines. the necessarily subjective nature of self-evaluation. 
The administrator's assessment of his ow'n accomplishments 
and failures necessitatesi measui ing behavior by personal goals 
(ar opposed to comparing oneself with others). The process 
of evaluating t)ncself is ''easicr said than done," requiring the 
ability to accept the results of that assessment, both failures 
and successes. 

Seif-evaluation of this sort will supplement the evaluator's 
opinions and provide a check on the evaluation system. The 
.results of sclf-evahiation arc a valid part of the total picture 
•..of administrative performance. Self-evaluation wall also give 
the administrator insight into his own performance and wili 
enable him to participate in the evaluation process. It can, in 
addition, help the administrator to see evaluation as something 
that happens with him, not to him. 



THE EVALUATION METHOD: 

FINDING THE RIGHT YARDSTICK 



FA'aluation methods fall into two general categories: the 
performance standards approach and the job targets approach. 
The performance standards process involves rating the admin- 
istrator against standards deterihined in advance by the dis- 
trict. Procedures utilizing objective rating instruments (such 
as checklists) a' e included in this category. The major assump- 
tion underlying this method of evaluation is that. administra- 
tor performance can be accurately and fairly measured by 
predetermined, objective'' criteria that measure general, 
overall peiformance (as opposed to the achievement of spe- 
cific goals) . 

Unlike the performance standards approach, the job targets 
approach measures administrative performance by determin- 
ing district goals, setting specific objectives, and assessing the 
administrator's success or failure in the achievement of these 
objectives. It usually allows for the administrator's direct par- 
ticipation in the objective-setting process, and the administra- 
tor himself often helps to determine the standards against 
which he will be measured* This approach draws on manage- 
ment by objectives theory adopted from busmess. 

The Performance Standards Approach 

Most evaluation instruments now used in the schools meas- 
ure an administrator against a set of predetermined perform- 
ance standards. Over threc-fom ths of the instrimients reported 
in a 1971 Educational Research Ser\'ice report are of this 
type. Checklists, secondary results evaluations, **filc"-evalua- 
tions, and a few other instruments employ the performance 
standards approach. 

Checklists ask an evalnator to compare an administrator's 
performance to a list of standards by rating the administrator 
on a scale, selecting a descriptive phrase, or commenting in 
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wriiintr. In nioj^i cases, the school (hstrict sets the standards, 
thereby outlining what it expects of an administrator. The 
evahiatioii ilsell' compares expectations to resuhs. 

The Washington Principal Kvalualion Inventory (\VPKl), 
prepare(l.h\' Richard Aiuhrws, is (y|)ical (jI checkhst iiistru- 
menis. 'I'he W'VVA lists adniinistratov responsibilities and asks 
the evalualor to circle the letter A ii' the achninisirator f/Zzf^vi- 
hdliiis the res]>onsibility, O iF he often fuirills it, OC if he 
occasionally lullills it,.S if he seldom liiilills it, and N if he 
urvcr lull ills it. Some u\' the listecl responsibilities are 

2. Gains ihc csiccm ol his staff by dcinonstruiing a genuine re- 
spect lor ihem 

8. Kacililales staff parlicipaliDn in commiinily activities 
- 9. Assists staff in understanding their professional roles and re- 
sponsibilities 

14. Organizes staff so that authority and responsibility are clearly 
understood 

18, Kffeclively contributes to the resolution of student discipline 
problems 

19, Establishes- an efficient communications network within tlie 
school 

. 25, Handles the routine functions of administration in an efficient 
manner 

2S, Contributes to orderly changes in the staff and the system 

40, Relates to staff members in informal as well as formal situations 

41, Operates within the framework of tiie established school sys- 
tem policies 

52, Understands the function of the school iu relation to the com- 
munity 

58. Understands tlie community and its impact on education 

59. Foresees those actions needed to improve the function of die 
school 

GO, Clearly interprets the school district's policies to his staff 

(>.S, Provides for efficient use of school equipment and facilities 

Beall describes a process desi,^ned to provide the adminis- 
trator with infonnatioii on how well he is contributing to 
learnin<4. in this process, the administrator and cvaluator meet 
to establish standards ol student progress and to agree ori 
techniques for assessing that progress. The evaluation then 
consists" of comparing actiuil and projected student progress. 
'I'his |)r()cess assumes tiiat the administrate^- has a vast measure 
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(.)!' controlOvcr an equally vast iuiiiibcr ol variables. 

Some school districts use personnel files and special evalua- 
tion files to rale administrators. Pharis describes such a proc- 
ess: 

.■\ file is maintained lor oacli person wlu) is to be evaluated. 
Evers'lliing - good and bad- that, comes to the attention of the 
evaliKUor goes into the folder, h might contain summaries of 
observations, statements of assistance rec} nested or given, tran- 
scripts of courses taken, letters of commendation and com- 
plaint, clippings, or anything else the file keeper finds. :\{ the 
appointed time the file is reviewed, and a judgment made. 

To perforni this type of evaluation, the evakiator must wade 
through an enormous quantity of largely irrelevant material. 

Denny suggests a different performance standards ap- 
proach: a report card to be filled out by the achn inistratoi: 
himself. The card consists of a combination of objective and 
subjective questions covering six general areas: pupils, pro- 
gram, [)crsonnei, professional improvement, ptiblic relations, 
and physical plant. 'Diis appioacli allr>\vs the administrator to 
rate himself, hut against standards already determined by the 
district. 

Carve II reports yet a different practice. The Ocean View, 
California, district uses a battery of instruments to determine 
administrator competence. The instruments are used in bat- 
tery to cover all aspects of administrative performance. ^ 

Perfc)i"mance standards evaluations of any kind are eco- 
nomical of time, energy, and money. They dv), hcnvevcr, have 
some sci ious draw[)acks. 

Since the evaluator is asked his opinion of how an adminis- 
trator measures up to a set of standards, the evaluation is 
highly subjective. Many instruments are poc)rly designed. The 
administrator is rarely, if ever, consulted in establishing the 
standards against which he will be measured. In addition, 
performance standards arc inflexible and do not allow for 
changes in circumstances or specific tasks. 

Pharis argues for an evaluation system that measures reality. 
He expects a well-designed system to consider only the varia- 
bles under an administrator's control. Such a system should 
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spell out clearly aiul in atlvanfc ihc-critcria against whith the 
adniiiiisirator js to he nieasured. 

KvaliKitioiis should not he .suhject to different conelusions 
hy different evahiators, and the 'achninistrator should he al- 
lowed some voice in det<:nninin^ 'i^oals. Onlv nnc evaluation 
approach cm'rently in use satislies^Miaris' criteria and avt)ids 
most of the pitfalls of tliL* |)erf()rniance standards apprt)ach: 
the joh targets approach. ; 

i 

The Job Targets Approach 

I 

In an attempt lo ensure fair and ieliahlc evaluations, many 
school districts arc tinning tt) joh targets evaluation. This ap- 
proach involves setting targets— oWcn cMi^d performance 
^ ohjeclives-'in advance, then determining the administrator's 
success at meeting tht)se targets. 

The joh targets approach is perhaps more time-consuming 
than the pevfoiinance standards appioach, hut it has several 
advantages. T'he evaluation is tailored to the administrator 
and to the specific johs he perl'orms. And it provides the dis- 
trict with reliahle evidence of the administrator's performance. 

Determining Job Targets 

As Bern.stcin and Sawyer remark, **the modern principal 
mu.st he evakuited in terms of how well he organizes the re- 
sources at his command, first to define and then to achieve 
iriily important joh targets.'' Actually, determining jol) targets 
involves two steps. The first step is deciding on district gt)als. 
The second is developing specific joh targets. 

General district goals, as noted previously in this paper, 
should he decided even hefore an evaluation system is imple- 
mented. Other, more specific goals may he set during the 
preevaluation conference. This goal-setting enahles the admin- 
istrator and his evaluator to see the full range of possihie joh 
targr.s. 

After goals are set, specific joh targets must he agreed on. 
Bernstein and Sawyer point out that the principal should for- 
nudate ''a thorough overview" of his staff's ideas ahoul what 
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should be done in the school, lakiii.t^ their desires into accoiint 
in the definition of joh targets. But heeause not all stafF 
views can be realist ifally. incorporated into job targets, the 
administrator and h.is siiperxisor should carelujK' weigh 
these suggestions to deterniine whifh are '^u'eeptahle and 
achievable." 

Nunici'ous lactoi's should he considered in setting tar- 
gets. Two major criteria arc outlined l)y Bernstein and Sawyer. 
Firsii the targt:ts nuist be *\lelinii ted'' so that they can be 
precisely defined by the administrator and his staff. Only 
through specific definition can the administiator be expected 
to achie\'e specific results. Second, *'a i'ixed period of lime, or 
perhaps ... a series oi i'ixed time-periods" should be estab- 
lished to ensure the successful completion t)i' the job targets. 
Targets may also be afiected by such xariables as monew per- 
sonnel, and comniunity opinion. 

Kach job target should be wVitten down and slu)ul(l include 
a target date and a description of the administratt)r\ projected 
course of action in reaching the targets This information will 
provide the basis lor the subsecpient exaluation. 

Establishing Criteria 

.-\fter job targets are agi-eed on, the administrat(jr and 
e\'aluatoi- must set criteria. They must agi-ee on what will be 
acceptable as evidence that the adnunistrator has accon\- 
plished each jol) target. 

'The performance (rileiia must be careiully formulated, 
since they form the basis of evaluation. Bernstein aiul Sawyer 
stale, that these criteria should define what ''minimally ac- 
ceptable periormance" will he, as well as determine the '*o[)ti- 
mum objectives, i.e., the best results that can reas()nably be 
hoped f()r." 

The setting of targets and the establishment of criteriir 
during the prcevalitation conference will give the adminis- 
trator a clear [)iclure of what he is tf) ac:complish and c)i" how 
his i)erforn"iance will be gauged. The e\'alual(^r >vill know what 
to look for in the course of the evaluation. 
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The Evaluation 



BctwccMi the lime of the prccval nation conference and the 
target date of each job target, the evaluaior must gather evi- 
dence of t^he achiiinistrator's performance. If self-evaluation is 
also a part of the process agreed on, the administrator should 
also collect evidence of his performance. 

One of the advantages of the job targets approach is its 
adaptability to changing circu instances. During the period of 
evahiation, the administrator and evaluator may agree on 
extending target dates, recognizing new criteria, or changing 
job targets. All such changes should, of course, be written up 
and appended to the materials fn)m the pvecvaluation con- 
ference. 

After the target dates, the evaluator and the -administrator 
should write up their respective evaluations. According to 
Red f ern, ^""■"'^ 

The evaluator must nuike a foriliright assessment of the extent 
lo which tlie principal has achieved success in attaining the 
predetermined performance goals. judgment must reflect 
a thorough knowledge of behavioral changes that| have taken 
place, recognition of supervisory assistance provided, and the 
. results that have been achieved. ; 

The same considerations apply to self-c\'aluation. 

Bernstein and Sawyer remind the evaluator that ''the only, 
evaluation ap[)ropriale lor the modern principal is that which 
rates liim in terms of how well— or how pt>orly— he achieved 
specific oi>jectives, and what qualities of leadership he revealed 
while administering his projects.'' Redfern adds a cautionary 
note, thai evaluations ''should be supportable by evidence 
gained by ob.servations and visitations, data collected, con- 
ferences held, and assistance pi'ovided.'" 

The evaluatic)!^ is Eiot complete without a postevaluation 
conference. .At this time, the evaluator and the administrator 
ran compare their evaluations, discuss the evidence, and re- 
cycle the results. 

Recycling the results involves determining followup action, 
'setting new jol) targets, ancl agreeing, once more, on criteria. 
The job targets approach to evaluation does not have a 



hc^iiiiiing, inicl(lk\ aiul ciul. It is an ingoing process. 

One District's Evaluation Plan 

One school district's experience with adniinistralor evahia- 
lion may he enhghtening to other districts initiating evahia- 
lion syslenis. Kiigene School District Number 4J in luigene, 
Oregon, has experimented over the past decade with several 
approaches to administrator evaluation. p.' 

The distric t initiated administrator evakialion to hold ad- 
niinistrators accountable for their peri'ormance. The inl'or- 
nun ion provided by Hie evaluation is used in considering 
t t)niraii renewal and in monitoring the prt)gress ol proba- 
lionar\- ailniinistiators. Ideally, evaluation also enables the 
disirici to im|)ro\'e the process of administiation. 

Asked which personnel are evaluated, \V. I. Williams, Direc- 
iDT of Personnel I'or the Kugene district, replied, ''All our 
adniinisiraiive stalf are tt) be eva.luated yearly by their super- 
vis()r." - W illiams als(^ stated that one t)f the major problems 
inherent in e\aluati(>n is that the public schools do not have 
enough trained e\ aluatit)n perst)nnel due to a lack of inservice 
ir.iining in evaluation. 

The Kugene district originally evaluated school adminis- 
trators with a teacher evaluatit^n instrument. The instrument 
outlined district philosophy and goals, provided guidelines 
l\>r (^valuators, and asked the evaluator to write brief sum- 
maries of the teacher's or administrator's performance in sev- 
eral areas. The form also provided space for recommendations 
('U aiUancement, s. lary, and dismissal. 

I he flaw in this type of evaluatit)n became apparent. The 
instrument was the same for each person and situation, but 
duties, goals, and personalities of administrators diflered. In 
short, the evaluation was a procrustean bed— the administra- 
tor had to fit the instrument, or else. 

For this reason the district turned to a different evaluation 
svsiem. The new proc ess begins with writing a job descrip- 
tion b>r eac-h administrator. I'hen the evaluation employs a 

♦"Inpcrson interview willi aulhor, April I, 1974. 
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c(jm hi nation o\' iiistruiiiciits: a checklist of general adminis- 
trative performance and a separate form for writing up "per- 
Ibrmance goals/' or job targets. 

This combir.ation of approaches enables the district to get 
a much more detailed picture of achiiinisiraior performance. 
As Williams noted, each person responds individually, and 
*'no mattei* what the goals are, the processes ought to be 
different." The job targets appr(.)ach allows the district to 
monitor each individual's approach to a problem or goal with- 
out setting arbitrary standards. The checklist adds a more sub- 
jective evaluation by the administrator's supervisor. 

The success Of the job targets aspect of the evaluation 
system has prompted the Eugene district to plan a new evalua- 
tion system relying more heavily on the job targets approach. 
Since the final details of the new system have yet to be 
worked out, little information is available. 

Williams indicated, however, that the new approach will 
involve mutual development of pciformancc goals by the ad- 
ministrator and his supervisor. lie reminded other districts 
that "performance goals should not be restrictive," and that 
the evaluatic)n process shoidcl always be amenable to change. 
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CONCLUSION 



The literature on achninistratov evaluation is often con- 
nijting. Sonic writers favor the i)erfornianee standards iip- 
proaeli in one of its many vaiiations; some prefer ihe job 
targets apj) roach. The i)er form a nee standards approach is by 
far the most common. The rcscarcti, however, gixes a great 
deal of credence to the job targets approach, which, ideally, 
tailors the evaluation to the indi\'icKial arul . to his specific 
tasks. 

The performance standards approach lends itself to arbi- 
trariness on the part of the district. All decisions concerning 
the e\aluation process ha\'e been made before the adminis- 
Iralor is called in foi' a precwil nation conference. He has no 
part in setting up the evaluation. The administrator is coi> 
suited a I every stage in job targets e valuation, however, lie 
heljDS set the specific tnrgcts and the criteria against which his 
pei formance will be measured. 

DeV'aughn reminds districts that there must be an agree- 
ment on the policies, procedures, and instruments to be used 
in the evaluation process." The administrator should know 
how, why, Lind when he is to be evaluated. Kvcn students are 
given that much warning before they are graded. 

'I 'he main point to be made in any discussion of adminis- 
trLitt>r evaluation is that both the district and the administra- 
tor should know what is happening: how the evaluation 
works, how far the results can be trusted, and how well the 
e\'aluati()n works to imi)r()\'e administrator jierformance. For, 
as Rosenberg notes, ''only \\^ith intelligent evaluation can edu- 
calitHV become clearly defined, Lichie\'cment oriented, and 
provided with a rational basis ^ for jjolicies and decisions and 
actions which lead to greater and greater impro\'cments.'* 
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